Advanced memory data structures for scalable event trace analysis
نویسنده
چکیده
5 1 Performance Analysis for HPC Applications 7 1.1 Computation and Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.2 Performance Analysis and Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . 8 1.3 Performance Analysis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 1.4 Contribution of this Thesis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2 State-of-the-Art in Event-Based Trace Analysis and Related Work 11 2.1 Tracing and Logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.2 Trace Analysis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.2.1 Vampir and VampirServer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.2.2 Paraver and Dimemas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 2.2.3 Kojak and Scalasca . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 2.2.4 Jumpshot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 2.2.5 Debugging Wizard (DeWiz) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 2.2.6 Tuning and Analysis Utilities (TAU) . . . . . . . . . . . . . . . . . . . . . . . . 26 2.3 Trace File Formats . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 2.3.1 Common Design of Trace File Formats . . . . . . . . . . . . . . . . . . . . . . 28 2.3.2 The Vampir Trace Format Version 3 (VTF3) . . . . . . . . . . . . . . . . . . . . 30 2.3.3 The Structured Trace Format (STF) . . . . . . . . . . . . . . . . . . . . . . . . 30 2.3.4 The Open Trace Format (OTF) . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 2.3.5 The Epilog Trace Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 2.3.6 The Jumpshot Trace Formats . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 2.3.7 The Paraver Trace Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 2.3.8 The DeWiz Trace Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 2.3.9 The TAU Trace Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 2.4 Memory Data Structures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 2.4.1 The Vampir and VampirServer Data Structures . . . . . . . . . . . . . . . . . . 35 2.4.2 The EARL Data Structures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 2.4.3 The DeWiz Data Structures . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 2.4.4 The TAU Data Structures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 2.4.5 Similarity to Trace File Formats . . . . . . . . . . . . . . . . . . . . . . . . . . 39 2.5 Access Methods to Event Data Structures . . . . . . . . . . . . . . . . . . . . . . . . . 39 2.5.1 Sequential Iterator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 2.5.2 Time Interval Search . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 2.5.3 Statistic Summaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 2.5.4 Timeline Visualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 2.5.5 Automatic Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 2.6 Event Trace Compression by Statistical Clustering . . . . . . . . . . . . . . . . . . . . . 45 2.7 Memory Access Traces and Compression . . . . . . . . . . . . . . . . . . . . . . . . . 46 2.8 Compression of MPI Replay Traces . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
منابع مشابه
Compressible memory data structures for event-based trace analysis
The article presents a new compressible memory data structure for trace events. Its primary intention is to aid the analysis of huge traces by reducing the memory requirements significantly. Furthermore, customized evaluation algorithms reduce the computational effort. The data structure as well as algorithms for construction and evaluation are discussed in detail. Experiments with real-life tr...
متن کاملThesis for the degree of Doctor of Philosophy Algorithms for synchronization and consistency in concurrent system services
Synchronization, consistency and scalability are important issues in the design of concurrent computer system services. In this thesis we study the application of optimistic and scalable methods in concurrent system services. In a distributed setting we study scalable tracking of the causal relations between events, lightweight information dissemination in optimistic causal order in distributed...
متن کاملCompression Analysis of Hollow Cylinder Basalt Continuous Filament Epoxy Composite Filled with Shape Memory Wire
This paper presents an experimental investigation into the compression behavior of shape memory alloy hybrid composites (SMAHC) subjected to quasi-static loading taking into account of rotation effects of shape memory wire in basalt continuous filament (BCF) direct roving epoxy composite. Two types of specimen prepared, the BCF direct roving reinforced epoxy composite filled with shape memory w...
متن کاملTimestamp synchronization of concurrent events
Supercomputing is a key technological pillar of modern science and engineering, indispensable for solving critical problems of high complexity. However, to effectively utilize the enormously complex large-scale computer systems available today, scientists and engineers need powerful and robust software development tools. One technique widely used by such tools is event tracing with a broad spec...
متن کاملA Tandem Scalable Microwave-Assisted Williamson Alkyl Aryl Ether Synthesis under Mild Conditions
An efficient tandem synthesis of alkyl aryl ethers, including valuable building blocks of dialdehyde and dinitro groups under microwave irradiation and solvent free conditions on potassium carbonate as a mild solid base has been developed. A series of alkyl aryl ethers were obtained from alcohols in excellent yields by following the Williamson ether synthesis protocol under practical mild condi...
متن کامل